Judging Mcmc Estimators by Their Asymptotic Variance
نویسنده
چکیده
The expectation of a function can be estimated by the empirical estimator based on the output of a Markov chain Monte Carlo method. We review results on the asymp-totic variance of the empirical estimator, and on improving the estimator by exploiting knowledge of the underlying distribution or of the transition distribution of the Markov chain.
منابع مشابه
Covariance Ordering for Discrete and Continuous Time Markov Chains
The covariance ordering, for discrete and continuous time Markov chains, is defined and studied. This partial ordering gives a necessary and sufficient condition for MCMC estimators to have small asymptotic variance. Connections between this ordering, eigenvalues, and suprema of the spectrum of the Markov transition kernel, are provided. A representation of the asymptotic variance of MCMC estim...
متن کاملStrong Consistency of Multivariate Spectral Variance Estimators in Markov Chain Monte Carlo
Markov chain Monte Carlo (MCMC) algorithms are used to estimate features of interest of a distribution. The Monte Carlo error in estimation has an asymptotic normal distribution whose multivariate nature has so far been ignored in the MCMC community. We present a class of multivariate spectral variance estimators for the asymptotic covariance matrix in the Markov chain central limit theorem and...
متن کاملNotes on Using Control Variates for Estimation with Reversible MCMC Samplers
A general methodology is presented for the construction and effective use of control variates for reversible MCMC samplers. The values of the coefficients of the optimal linear combination of the control variates are computed, and adaptive, consistent MCMC estimators are derived for these optimal coefficients. All methodological and asymptotic arguments are rigorously justified. Numerous MCMC s...
متن کاملImproving Asymptotic Variance of MCMC Estimators: Non-reversible Chains are Better
I show how any reversible Markov chain on a finite state space that is irreducible, and hence suitable for estimating expectations with respect to its invariant distribution, can be used to construct a non-reversible Markov chain on a related state space that can also be used to estimate these expectations, with asymptotic variance at least as small as that using the reversible chain (typically...
متن کاملNonasymptotic bounds on the estimation error for regenerative MCMC algorithms∗
MCMC methods are used in Bayesian statistics not only to sample from posterior distributions but also to estimate expectations. Underlying functions are most often defined on a continuous state space and can be unbounded. We consider a regenerative setting and Monte Carlo estimators based on i.i.d. blocks of a Markov chain trajectory. The main result is an inequality for the mean square error. ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1998